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TITLE OF THE INVENTION 
IMAGE SENSING APPARATUS, IMAGE SENSING METHOD, 
PROGRAM FOR REALIZING THE IMAGE SENSING METHOD, AND 
STORAGE MEDIUM WHICH STORES THE PROGRAM 

5 

FIELD OF THE INVENTION 

The present Invention relates to an Image sensing 
apparatus such as a digital camera which senses an 
object . 

10 

BACKGROUND OF THE INVENTION 

Conventional Image sensing apparatuses require 
various condition settings In accordance with a scene 
to be photographed, and are cumbersome to a user who is 
15 not accustomed to dealing with such complicated 

apparatus . Corresponding image processing has settings 
determined by the manufacturer, which do not always 
satisfy the photographer's demand. 

20 SUMMARY OF THE INVENTION 

It is an object of the present Invention to 
eliminate cumbers omeness and Improve the photographer's 
convenience by inputting settings to an image sensing 
apparatus by the user. 

25 More specifically, an in-focus position is 

conventionally determined within an object distance 
range of 0 to oo, requiring a long determination time. 
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This In- focus position determination time Is shortened. 
When the flash emits light In order to illuminate an 
object, a test emission amount for determining an 
emission amount in actual photographing is determined 
5 to a proper value. A white detection range for 
detecting white image data used in white balance 
processing is set to a proper range. 

To achieve the above object, according to the 
first aspect of the present invention, an image sensing 

10 apparatus is comprising a memory which stores 

information on a photographing frequency in association 
with object distance information and brightness 
information, an acquisition device which acquires an 
object brightness value on the basis of image 

15 information sensed by an image sensing device, and a 

control device which refers to the memory to detect an 
object distance having the highest photographing 
frequency among object distances corresponding to the 
acquired object brightness value, and controls image 

20 sensing operation on the basis of the detected object 
distance Information. 

According to the second aspect of the present 
invention, an image sensing method is comprising 
acquiring an object brightness value on the basis of 

25 image information sensed by an image sensing device, 
referring to a memory which stores Information on a 
photographing frequency In association with object 
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distance information and brightness information, 
thereby detecting an object distance having the highest 
photographing frequency among object distances 
corresponding to the acquired object brightness value, 
5 and controlling image sensing operation on the basis of 
the detected object distance Information. 

According to the third aspect of the present 
invention, an image sensing apparatus is comprising a 
memory which stores information on a photographing 

10 frequency in association with object distance 

information and brightness information, an acquisition 
device which acquires an object brightness value on the 
basis of image information sensed by an image sensing 
device, and a control device which refers to the memory 

15 to control image sensing operation on the basis of 

object distance information having a high photographing 
frequency among object distances corresponding to the 
acquired object brightness value. 

According to the fourth aspect of the present 

20 Invention, an image sensing method is comprising 

acquiring an object brightness value on the basis of 
image information sensed by an image sensing device, 
and referring to a memory which stores Information on a 
photographing frequency in association with object 

25 distance Information and brightness Information, 

thereby controlling image sensing operation on the 
basis of object distance Information having a high 
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photographing frequency among object distances 
corresponding to the acquired object brightness value. 

Other features and advantages of the present 
Invention will be apparent from the following 
5 description taken in conjunction with the accompanying 
drawings , In which like reference characters designate 
the same or similar parts throughout the figures 
thereof . 

10 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 Is a block diagram showing an Image 
sensing apparatus according to the first embodiment; 

Fig. 2 is a view showing an example of a database 
stored In an iSAPS unit 105; 
15 Fig. 3 is a graph showing an example of the 

relationship between the object distance and the 
photographing frequency at brightness value XI; 

Fig. 4 is a flow chart showing operation 
processing of automatic focus adjustment of the image 
20 sensing apparatus according to the first embodiment; 
Fig. 5 is a flow chart showing operation 
processing of setting the test emission amount and 
white detection range of the image sensing apparatus 
according to the first embodiment; 
25 Fig. 6 is a graph showing a setting example of 

the white detection range; 

Fig. 7 is a view showing an example of a 
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detection block; 

Fig. 8 Is a block diagram showing an Image 
sensing apparatus according to the second embodiment; 

Figs. 9A and 9B are flow charts showing operation 
5 processing of the image sensing apparatus according to 
the second embodiment; 

Fig. 10 Is a block diagram showing an Image 
sensing apparatus according to the third embodiment; 

Fig. 11 is a flow chart showing operation 
10 processing in the playback mode of the image sensing 
apparatus according to the third embodiment; 

Fig. 12 is a view showing an example of a 
database stored in an iSAPS unit 105 (storage device 



113); 



15 



Fig- 13 is a flow chart showing operation 



processing in the photographing mode of the image 



sensing apparatus according to the third embodiment; 



Fig. 14 is a flow chart showing rec view 



processing according to the third embodiment; and 



20 



Figs. 15A and 15B are views showing examples of 



an image display in rec view processing according to 



the third embodiment. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 



25 



Preferred embodiments of the present invention 



will be described below with reference to the 



accompanying drawings. 
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(First Embodiment) 

Fig. 1 Is a block diagram schematically showing 
an Image sensing apparatus according to the first 
embodiment . 

5 A lens optical system 101 comprises a lens 

optical system Including a lens for adjusting the 
focus, a stop, and a mechanical shutter. A CCD 102 Is 
an Image sensing element, and foirms on Its Image 
sensing plane an object Image Incident via the lens 

10 optical system. An A/D converter 103 converts an 

analog Image signal photoelectrlcally converted by the 
CCD 102 Into a digital Image signal. 

An AE processor 104 obtains an object brightness 
value on the basis of the input digital image signal. 

15 The AE processor 104 controls the stop and shutter of 
the lens optical system 101 on the basis of the 
brightness value. 

An iSAPS (intelligent Scene Analysis based 
Photographic Space) unit 105 sets a focus lens scanning 

20 range for determining an in- focus position for an AF 
processor 106 on the basis of the object brightness 
value obtained by the AE processor 104 (to be described 
later). The iSAPS unit 105 sets the test emission 
amount of a flash for illuminating an object for an EF 

25 (Electric Flash) processor 107 on the basis of the 

object brightness value obtained by the AE processor 
104. The ISAPS unit 105 sets a white detection range 
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for detecting, from digital Image data, white Image 
data for calculating a white balance control signal for 
a white balance processor 109 on the basis of the 
object brightness value obtained by the AE processor 
5 104. 

An Image processor 110 performs T conversion for 
an image signal, and a format converter 111 compresses 
the image signal by JPEG or the like to convert its 
format. An image recording unit 112 writes the image 

10 signal in the internal memory of the image sensing 
apparatus or a detachable external memory such as a 
compact flash®. Each building component of the image 
sensing apparatus is controlled by a CPU (not shown). 

A method of setting the focus lens scanning range 

15 will be described as a feature of the first embodiment. 

The iSAPS unit 105 stores a database as shown in 
Fig. 2. This database represents the frequency of 
photographing at a given object distance with a given 
object brightness. As the frequency comes closer to 

20 the center of the circle (the color becomes darker), 

the frequency of past photographing is higher. Fig. 3 
is a graph at XI in Fig. 2. SO to SIO in Fig. 3 are 
sampling points for detecting an in-focus position. 
Fig. 4 is a flow chart showing operation 

25 processing when the focus of the image sensing 
apparatus according to the first embodiment is 
automatically adjusted. 
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In Step Sll, the AE processor 104 obtains an 
object brightness value. In step S12, a distance Y 
(see Fig. 3) having the highest photographing frequency 
Is detected using the database of Fig. 2 from object 
5 distances corresponding to the brightness value 
obtained in step Sll. 

In step S13, whether it Is difficult to detect an 
image signal having the high-frequency portion of the 
object due to, e.g. , an excessively low object 

10 brightness and automatic focus adjustment is Impossible 
is determined. 

If adjustment is possible, the flow advances to 
step S14 to limit a predetermined brightness range of 
Yl to Y2 (Si to S4) that is centered on the detected 

15 object distance Y to the focus lens scanning range, 

thereby setting the brightness range (i.e., the focus 
lens is driven within a range where the lens is focused 
at the object distances Yl to Y2). The flow advances 
to step SI 5 to actually scan the focus lens within the 

20 range, and determine as a focus lens position a 

position where the largest number of image signals 
having the high-frequency portion of the object is 
detected. 

If adjustment is impossible, the flow advances to 
25 step S14 to determine a focus lens position so as to 
adjust the focus to the detected object distance, and 
drive the focus lens to the position. 
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A method of setting the test emission amount and 
the white detection range of image data according to 
the first embodiment will be explained with reference 
to the operation processing flow chart of the image 
5 sensing apparatus in Fig. 5. 

In step S21, an object distance corresponding to 
the in- focus position of the focus lens adjusted by the 
AE processor 104 Is detected (in order to increase the 
processing speed, this object distance may be replaced 

10 with an object distance having the highest 

photographing frequency that is detected in step S12). 
The flow advances to step S22 to determine whether the 
object brightness value is equal to or less than x and 
the object distance Is equal to or less than y. 

15 If YES in step S22, the flow advances to step 

S23. The EF processor 107 sets, to an indoor value, a 
test emission amount for setting an emission amount in 
actual exposure of taking a picture to be actually 
recorded. A flash 108 then emits light. An actual 

20 emission amount is determined by calculation processing 
using a brightness obtained by photometry in 
synchronism with test emission and an external light 
intensity obtained by photometry before test emission. 
Note that an Indoor test emission amount is set smaller 

25 than an outdoor test emission amount. For follow-up by 
the color temperature range of a fluorescent lamp, the 
white balance processor 109 sets a range wider than the 
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outdoor white detection range (a In Fig. 6). The white 
balance processor 109 controls the white balance of an 
actual exposure Image signal on the basis of an Image 
signal falling within the set white detection range 
5 from the Input digital Image signal. 

If NO In step S22, the flow advances to step S24 . 
The EF processor 107 sets, to an outdoor value, a test 
emission amount for setting an emission amount In 
actual exposure of taking a picture to be actually 

10 recorded. The flash 108 then emits light. An actual 

emission amount Is determined by calculation processing 
using a brightness obtained by photometry In 
synchronism with test emission and an external light 
Intensity obtained by photometry before test emission. 

15 The white balance processor 109 sets a white detection 
range to be followed by the outdoor color temperature 
range (b In Fig. 6). The white balance processor 109 
controls the white balance of an actual exposure image 
signal on the basis of an image signal falling within 

20 the set white detection range from the input digital 
image signal. 

A detailed method of calculating a white balance 
control coefficient will be explained. Fig. 6 shows 
Indoor and outdoor white detection ranges. In Fig. 6, 

25 the X-axis (Cx) corresponds to the color temperature of 
the light source, and the Y-axis (Cy) corresponds to 
the correction amount in the green direction. The 
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first embodiment will exemplify an Image sensing 
element using a primary color filter. Note that 

Cx = (R - B)/Y 

Cy = (R + B - 2G)/Y 
5 Y = (R + G + B)/2 . . . (1) 

An Input signal from the Image sensing element Is 
divided Into arbitrary blocks, as shown In Fig. 7. A 
white evaluation value (Cx,Cy) Is calculated for each 
block, and whether the value falls within the white 
10 detection range In Fig. 6 Is determined. As described 
above, the white detection range Is set to the white 
detection range (a) for "Indoor" determination and the 
white detection range (b) for "outdoor" determination. 
The Integral values (SumRw, SumGw, and SumBw) of output 
15 values (R(l), G(l), and B(l)) from the respective color 
filters of blocks within the range, and a total sample 
number SampleWNum are calculated: 

SumRw = 2R(i) 

SumGw = Eg(1) 
20 SumBw = 28(1) 

SampleWNum = S Sample ( 1 ) . . . ( 2 ) 

White balance coefficients are calculated from the 
Integral values: 

WBr = l/( SumRw/ SampleWNum) 
25 WBg = l/( SumGw/ SampleWNum) 

WBb = l/(SumBw/SampleWNum) ...(3) 

By using these white balance coefficients, the 
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white balance processor 109 can properly adjust the 
white balance . 

The white balance detection range is not limited 
to Fig . 6 . The outdoor white detection range may be 
5 set to a high -color- temperature range so as to follow a 
high color temperature, and the indoor white detection 
range may be set to a lower color temperature than the 
outdoor white detection range. 

As described above, the automatic focus 

10 adjustment time can be shortened by estimating an 

in- focus position on the basis of the object brightness 
value and the photographing frequency corresponding to 
the brightness value and narrowing the focus lens 
scanning range. 

15 Indoor or outdoor photographing is determined on 

the basis of the object brightness value and the object 
disteuice corresponding to the in-focus position. A 
white detection range for calculating a proper 
flashlight amount and white balance control coefficient 

20 can be set, realizing quick, appropriate processing. 
(Second Embodiment) 

The second embodiment concerns an image sensing 
apparatus having a learning function capable of storing 
and updating status data (object distance, image 

25 brightness, and photographing frequency) obtained every 
photographing in a database (storage device) 113 of an 
iSAPS unit 105. The second embodiment can provide an 
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Image sensing apparatus which reflects a different 
photographing taste for each photographer and is 
convenient for the photographer. 

Fig. 8 Is a block diagram showing an image 
5 sensing apparatus according to the second embodiment. 
Blocks having the same reference numerals as those In 
Fig. 1 execute the same processes, and a description 
thereof will be omitted. 

The image sensing apparatus according to the 
10 second embodiment comprises a learning function SW 114, 
and whether to execute the learning function for the 
ISAPS unit 105 is controlled. 

When the learning function is set ON for the 
ISAPS unit 105, distance information Y obtained by an 
15 AF processor 106 and a brightness value X obtained by 
an AE processor 104 are newly stored in the storage 
device 113, updating the stored database. 

Whether to change a threshold (x,y) used in 
"outdoor/ indoor" determination shown in Fig. 3 is 
20 comprehensively determined from a numerical value 

representing correctness of "Indoor /outdoor" prediction 
based on an {x,y) value obtained by an EF processor 107 
and WB processor 109, and an Indoor or outdoor state 
near the (x,y) value. If the threshold is determined 
25 to be changed, the database stored in the storage 
device 113 is updated. 

Operation processing of the image sensing 
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apparatus according to the second emboddunent will be 
explained with reference to the flow charts of Figs. 9A 
and 9B. 

In step S601, the AE processor 104 obtains an 
5 object brightness value X. In processing of step S603 
by the iSAPS unit 105, the iSAPS unit 105 searches the 
database 113 for an object distance YO having the 
highest frequency among brightness values corresponding 
to the obtained brightness value X. The iSAPS unit 105 
10 obtains an object distance range (Y1,Y2) where the 

frequency value exceeds a given threshold around the 
object distance YO . 

In step S602, the AF processor 106 receives the 
obtained object distance YO having the highest 
15 frequency and the value of the object distance range 

{Y1,Y2) from the iSAPS unit 105. The AF processor 106 
sets as a scanning range a focus lens driving range 
corresponding to the object distance range (Y1,Y2), and 
performs focusing operation. In the excimple of Fig. 3, 
20 steps SI to S4 define an object distance range 
corresponding to the scanning range. 

If focusing operation ends in step S604, the flow 
advances to step S610. If no in-focus position is 
obtained within the scanning range, the flow advances 
25 to step S605. 

In step S605, a change in the focusing degree of 
the focus lens at each position is confirmed, and 
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whether the In-focus position is closer to infinity or 
minimiim object distance with respect to {Y1,Y2) is 
determined. If the in- focus position is determined to 
exist at infinity, the flow advances to step S606 to 
5 set the object distance range corresponding to the 

scanning range to (Y2,oo), and start focusing operation 
again. If focusing operation is completed in step 
S608, the flow advances to step S610; if NO, to step 
S612. 

10 If the in-focus position is determined in step 

S607 to exist at minimum object distance, the object 
distance range corresponding to the scanning range is 
set to (0,Y1), and focusing operation is performed 
again. If focusing operation is completed in step 

15 S609, the flow advances to step S610; if NO, to step 
S612. 

In step S610, an object distance Y corresponding 
to the in-focus position of the focus lens is acquired. 
If the learning function SW 114 is ON in step S611, the 
20 acquired object distance Y and the brightness value X 
acquired in step S601 are output to the iSAPS unit 105 
to update data in the database 113. 

In processing of step S612 when no in-focus 
position is obtained, the in-focus position is made to 
25 correspond to the object distance Y = YO obtained in 
step S602, and the focus lens is driven. 

In step S613, whether the object is Indoor or 
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outdoor Is determined from the obtained brightness 
value X and distance Information Y. As determination 
Information, the threshold (x,y) stored In the database 
113 from the ISAPS unit 105 Is used. 
5 If the object brightness value X is equal to or 

less than x and the object distance Y Is equal to or 
less than Indoor photographing Is determined In step 
S614, and the flow advances to step S615. If NO in 
step S614, the flow advances to step S616. 

10 In steps S615 and S616, whether to emit light 

from the flash is determined. If YES In step S615 or 
S616, the flow advances to Indoor emission and actual 
emission amount determination processing in step S617 
or outdoor pre-emisslon and actual emission amount 

15 determination in step S618. If NO in step S615 or 
S616, the flow advances to indoor AWB processing in 
step S625 or outdoor AWB processing in step S626. 

In steps S617 and S616, a test emission amount 
for setting an emission amount in actual exposure is 

20 detennlned in accordance with the difference between 
outdoor photographing and Indoor photographing. The 
test emission amount is set small for Indoor 
photographing and large for outdoor photographing. An 
actual emission amount is determined by calculation 

25 processing using a brightness value obtained by 

photometry in synchronism with test emission and an 
external light intensity value obtained by photometry 
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before test emission. 

After the actual emission amount Is determined, 
whether "Indoor/ outdoor" prediction In step S614 is 
correct is determined. This is determined from the 
5 error between an emission amount predicted on the basis 
of an external light intensity value obtained by 
photometry before test emission and an object distance 
obtained by distance measurement, and an actual 
emission amount attained from a brightness value 

10 obtained by photometry along with test emission and an 
external light intensity value obtained by photometry 
before test emission. 

If "indoor /out door" determination is determined 
to be correct, the flow advances to indoor AWB 

15 processing in step S625 or outdoor AWB processing in 
step S626. If "Indoor /out door" determination is 
determined not to be correct, the flow advances to step 
S621 or step S622. A numerical value representing the 
degree of incorrectness of "indoor/outdoor" 

20 determination is acquired as an error eunount. This 
error amount is , e.g., an error amount between an 
emission amount predicted in test emission and an 
actual emission amount, as described above. 

Whether the learning function SW 114 in Fig. 1 is 

25 ON is determined in step S623 or S624, and if YES, the 
error amount is sent for XY "indoor /outdoor" 
redefinition in processing 633 and used in processing 
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of determining whether to change the state In which the 
(x,y) value represents "indoor" or "outdoor". 

I£ photographing is determined in step S621 to be 
originally outdoor photographing, the flow advances to 
5 outdoor AWB processing in step S626. If photographing 
is determined in step S622 to be originally indoor 
photographing, the flow advances to Indoor AWB 
processing in step S625. 

In step S625, indoor AWB (Automatic White 

10 Balance) processing is performed. In step S626, 

outdoor AWB (Automatic White Balance) processing is 
performed. White balance processes in steps S625 and 
S626 are the same as those in steps S23 and S16 
described in the first embodiment, and a description 

15 thereof will be omitted. 

In step S627 or S628, whether "Indoor /outdoor" 
prediction in step S619 or S620 is correct is 
determined from the result of processing in step S625 
or S626. This is determined from the distribution of 

20 color Information (Cx,Cy) values given by equation (1) 
on the graph shown in Fig. 6 (for example, if values 
are distributed in a wide range along the Cy axis , 
indoor photographing is determined, and if values are 
distributed within a narrow range, outdoor 

25 photographing is determined) , or from the white balance 
coefficients calculated by equations (3). If 
"indoor/ outdoor" determination is determined to be 
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correct, a predetermined photographed Image is 
processed to create a proper output image signal. If 
"indoor /outdoor" determination is determined not to be 
correct, the flow advances to step S629 or S630. A 
5 numerical value representing the degree of 

incorrectness of "indoor /outdoor" determination is 
acquired as an error amount. As described above, the 
variance of (Cx,Cy) values given by equations (1) on 
the graph shown in Fig. 6, or the distribution number 

10 in each of blocks prepared by dividing the graph of 

Fig. 6 may be obtained, and the area of a block which 
exceeds a given threshold may be obtained. In addition 
to them, a unique function using the white balance 
coefficients calculated by equations (3) may be used. 

15 Whether the learning function SW 114 in Fig. 1 is 

ON is determined in step S631 or S632, and if YES, the 
flow advances to XY "indoor /outdoor" redefinition in 
step S633. Whether to change the (x,y) value from 
indoor or outdoor processing to outdoor or indoor 

20 processing is determined on the basis of data on the 
error amount and accumulated data. 

In step S633, whether to change the {X,Y) value 
defined as the indoor/ outdoor threshold is 
comprehensively determined on the basis of a flash 

25 emission amount, a flash emission amount obtained when 
the "indoor /out door" determination result in white 
balance processing is determined to be incorrect, or 
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the error amount of white balance processing. For 
example, if the error amount is larger than a given 
value and Is determined to be changed, the threshold 
(X,Y) held by the ISAPS unit 105 is defined again by 
5 changing it by a predetermined amount. 

The operation of the image sensing apparatus 
according to the second embodiment has been described. 

In the above description, learned data is stored 
in the storage device 113 of the iSAPS unit 105. 

10 Alternatively, an external storage device 115 may be 
separately connected to the ISAPS unit 105 in Fig. 8. 
Under the control of a controller 116 in the iSAPS unit 
105, the external storage device 115 allows writing in 
the external storage device 115 the database in Fig. 2 

15 which is stored in the storage device 113, and reading 
out the database stored in the external storage device 
115 to the storage device 113. Accordingly, the 
database can be shared between different image sensing 
apparatuses or photographers who perform different 

20 photographing operations, and common photographing 
conditions can be obtained between different image 
sensing apparatuses. The image sensing apparatus can 
always be returned to an initial state by storing 
initial data before learning in the external storage 

25 device 115. 

The database stored in the storage device 113 and 
a plurality of databases stored in the external storage 
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device 115 can be edited Into one database, and the 
resultant database can be written in either or both of 
the storage device 113 and external storage device 115. 
As a detailed database editing method, frequency values 
5 at (x,y) values in the editing source database are 
added for the brightness value x and distance 
information y. In this manner, a plurality of 
databases can be edited into one database, and 
photographing can be done using the common database 

10 between different image sensing apparatuses or 

photographers who perform different photographing 
operations . 

In the second embodiment of the present 
invention, the determination condition representing an 

15 indoor or outdoor state in the iSAPS unit 105 takes 
only two values "YES" and "NO". Instead, indoor 
photographing and outdoor photographing may be made to 
correspond to 1 and 0, respectively, and data having 
consecutive state coefficients from 1 to 0 may be held. 

20 In this case, indoor or outdoor pre-emission and the 

test emission amount for determining an actual emission 
amount in step S617 or S618. and the white detection 
range of indoor or outdoor AWB processing in step S625 
or S626 are successively changed from indoor data to 

25 outdoor data in correspondence with a change in the 
state coefficient from 1 to 0 . If the indoor or 
outdoor state of (X,Y) is determined in step S633 to be 
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Changed on the basis of the flash emission amount or 
the error amount of white balance processing, the state 
coefficient serving as an error amount function is 
changed as a continuous quantity between 1 and 0. 
5 As described above, the second embodiment can 

provide an image sensing apparatus which copes with the 
taste of each photographer by performing processing of 
the image sensing apparatus. 
(Third Embodiment) 

10 The third embodiment is a modification to the 

second embodiment. In the third embodiment, the user 
confirms a photographed image, and selects whether to 
add data on the image sensing condition of the 
photographed image to a database. 

15 Fig. 10 is a block diagreun showing an image 

sensing apparatus according to the third embodiment. 
The same reference numerals as those in the above 
embodiments denote blocks which perform the same 
processes, and a description thereof will be omitted . 

20 In Fig. 10, a system controller 116 controls the 

system of the whole image sensing apparatus including a 
photographing sequence (the second embodiment has not 
described such system controller, but comprises the 
same arrangement as the system controller 116). A VRAM 

25 117 is an image display memory, and a display 118 is, 
e.g., an LCD which displays an image, an operation 
assistant display, and the state of the image sensing 
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apparatus. An operation unit 119 is a member for 
externally manipulating a camera. A mode switch 120 
switches between a photographing mode in which an image 
is photographed and recorded, and a playback mode in 
5 which a photographed image is played back. A main 
switch 121 is a switch for turning on the system « a 
switch (SWl) 122 is a switch for performing 
photographing standby operation such as AF or AE, and a 
switch (SW2) 123 is a photographing switch for 

10 performing photographing after operation of SWl. A 
DRAM 124 is used as a high-speed buffer which is a 
temporary image storage device, or a work memory for 
compressing /decompressing an image. 

The operation unit 119 includes the following 

15 members: a menu switch for various settings including 
the photographing function of the image sensing 
apparatus and image setting, a cross key for selecting 
a playback image, a zoom lever for designating zoom 
operation of a photographing lens, and a switch for 

20 switching between photographing modes such as a program 
photographing mode, landscape photographing mode, and 
portrait photographing mode. 

Fig. 11 is a flow chart showing operation 
processing in a playback mode in which an image is 

25 played back in the image sensing apparatus according to 
the third embodiment. Operation processing according 
to the third embodiment will be explained with 



- 23 - 



CFM03264/P203-0404 



reference to Fig. 11. 

In step S201, an Image recorded in an image 
recording unit 112 is read out in accordance with 
selection operation by ttxe user. In step S202, 
5 pre-processing for display on the display 118 is 

executed. More specifically, the image read out in 
step S201 is temporarily stored in the DRAM 124, image 
data decompression processing and sampling processing 
for display on the display 118 are performed, and the 

10 resultant image is stored in the VRAM 117. 

In step S203, the image stored in the VRAM 117 
undergoes video processing to display the image on the 
display 118. The flow advances to step S204 to 
determine whether display of another image is input 

15 from the operation unit 119 by user operation. If 

another image is selected, the flow advances to step 
S201; if NO , to step S205. 

In step S205, whether a database information 
display shown in Fig. 12 has been selected as a menu 

20 item by operating, e.g., the menu switch of the 

operation unit 119 is determined. If YES in step S205, 
the flow advances to step S206; if NO, to step S203. 

In step S206, a brightness value x and object 
distance information y as photographing status data of 

25 the image played back in step S203 are read out from 

the header of the played-back image file. The database 
information in Fig. 12 is read out from the storage 
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device 113, and a marker Is displayed at a position 
corresponding to the brightness value x and object 
distance Information y of the playback Image In the 
database. Note that Fig. 12 Is equivalent to the 
5 three-dimensional view of the database shown In Fig. 2. 
In step S207, whether It has been selected by 
user operation using the operation unit 119 to add to 
the database the brightness value x and object distance 
Information y corresponding to the playback image Is 

10 determined. If YES in step S207, the flow advances to 
step S208; If NO, to step S203. In step S208, the 
brightness value x and object distance information y 
corresponding to the playback image are added to the 
database. That is, the frequency value at (x,y) 

15 corresponding to the playback image Is Incremented by 
one, and the flow returns to step S203. 

As described above, according to the third 
embodiment, while the photographer sees a playback 
image, he/she can selectively add the image to the 

20 database depending on the degree of satisfaction. The 
photographer can create an appropriate database. 
Improving convenience. The positioning of image 
sensing conditions upon photographing a playback image 
in the database can be confirmed. 

25 Also, according to the third embodiment, the 

image sensing conditions of an image photographed by 
another image sensing apparatus can also be added to 
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the database. 

In the third embodiment, processes as shown in 
Figs. 13 and 14 may be done. 

Fig. 13 is a flow chart showing operation 
5 processing in the photographing mode of the image 

sensing apparatus according to a modification to the 
third embodiment. 

In step S401 of Fig. 13, whether SW2 has been 
pressed is determined. If YES in step S401, the flow 
10 advances to step S402; if NO, to step S401. In step 

5402, image sensing processing is performed to obtain 
an object image as an output image signal. In step 

5403, the obtained output image signal is temporarily 
stored in the DRAM 124. 

15 In step S404, whether a rec view (processing of 

displaying an image immediately after photographing on 
the display 118 in order to cause the user to confirm 
the image) has been set is determined. If the rec view 
is ON, the flow advances to step S405; if NO, to step 

20 S407. 

In step S405, recording start processing of 
recording an image stored in the DRAM 124 in the image 
recording unit 112 is executed. In step S406, rec view 
processing is done in parallel with recording 
25 processing in the image recording unit 112. After 

recording processing and rec view processing, the flow 
returns to step S401. The image stored in the DRAM 124 
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is recorded in the image recording unit 112 in step 
S407, and then the flow returns to step S401. 

Rec view processing of step S406 in the flow 
chart of Fig. 13 will be explained with reference to 
5 the flow chart of Fig. 14. 

In step S501, whether the image sensing 
conditions of an image to be displayed on the rec view 
have been set to be checked by setting using the 
operation unit 119 is determined. If YES in step S501, 

10 the flow advances to step S502; if NO, to step S503. 
In step S502, the coincidence with the 
distribution of the entire database stored in the 
storage device 113 is examined for the brightness value 
X and distance information Y of the rec view image. 

15 The coincidence is examined by determining, for 

example, whether (X,Y) has a frequency value equal to 
or larger than a predeteimined threshold. 

In step S503, pre-processing for display on the 
display 118 is executed. In step S504, if the 

20 brightness value X and distance information Y are 

determined in step S502 to coincide with the database, 
"OK" representing coincidence is displayed at the same 
time as display of the rec view image, as shown in 
Fig. 15A (predetermined sound may be output from a 

25 sound generation portion such as a loudspeaker, or 

light may be emitted by a light -emitting portion such 
as an LED (not shown)). If NO in step S502, "NG" 
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warning noncolncldence is displayed, as shown In 
Fig. 15B. Alternatively, a display which promotes 
addition of image sensing conditions corresponding to a 
sensed image to the database may be done. Upon the 
5 lapse of a predetermined time in step S505, the display 
ends in step S506. 

By the above -de scribed photographing processing 
of the image sensing apparatus, the coincidence with 
the distribution of the database can be confirmed for 
10 status data of an image displayed by the rec view 
immediately after photographing. 

The present invention is also achieved when, for 
example, software program codes for realizing the 
functions of the above -described embodiments are 
15 supplied to an image sensing apparatus via a network 
such as the Internet, and the computer (or the CPU or 
MPU) of the image sensing apparatus reads out and 
executes the program codes stored in the storage medium. 

In this case, the program codes read out from the 
20 storage medium realize the functions of the CPU in the 
above -described embodiments, and the storage medium 
which stores the program codes constitutes the present 
invention - 

The storage medium for supplying the program codes 
25 includes a floppy* disk, hard disk, optical disk, 
magnetooptical disk, CD-ROM, CD-R, magnetic tape, 
nonvolatile memory card, and ROM. 
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The functions of the above -de scribed embodiments 
are realized when the computer executes the readout 
program codes. Also, the functions of the 
above -de scribed embodiments are realized when an OS 
5 (Operating System) or the like running on the computer 
performs part or all of actual processing on the basis 
of the Instructions of the program codes. 

Furthermore, the functions of the above -described 
embodiments are realized when the program codes read 
10 out from the storage medium are written In the memory 
of a function expansion boeurd inserted Into the 
computer or the memory of a function expansion unit 
connected to the computer, and the CPU of the function 
expansion board or function expansion unit performs 
15 part or all of actual processing on the basis of the 
Instructions of the progreun codes. 

When the present Invention Is applied to the 
storage medium, the storage medium stores program codes 
corresponding to the above-described flow charts. In 
20 short, modules Indispensable to the Image sensing 

apparatus of the present invention are stored in the 
storage medium. 

As has been described above, the embodiments can 
eliminate cximbersomeness and Improve the photographer's 
25 convenience by inputting settings to an image sensing 
apparatus by the user. 

As many apparently widely different embodiments 
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of the present invention can be made without departing 
from the spirit and scope thereof, it is to be 
understood that the invention is not limited to the 
specific embodiments thereof except as defined in the 
5 appended claims. 
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